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[Name of the Document] Specification 
[Title of the Invention] 

METHOD AND APPARATUS FOR EXTRACTED DIGITAL 
WATERMARK STATISTICAL PROCESSING 
5 [Claims] 

1 . A method for embedding digital watermarlc 
data in digital data contents^ said method comprising 
the step of: 

reconstituting said digital watermarlc data embedded 
10 in digital data contents from said bit sequence 

extracted from digital data contents before being 
reconstituted by using a test method on the basis of 
binary distribution in statistics. 

15 2. The method as claimed in claim 1, further 

comprising the steps of: 

presetting a reliability threshold value ol of the 
extracted digital watermarlc data ; 

obtaining a binary distribution function F(x) which 

20 represents a probability that a number x of ^1' bits or 
'0' bits are included in a bit sequence which is read at 
random from digital data contents, said binary 
distribution function F (x) being obtained by using a 
probability q of reading '1' or '0' in said bit sequence 

25 and a repeating number of embedding each bit of digital 
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watermark data; 

reading an ith digital watermark sequence of said 
digital watermark data from a digital watermark area of 
said digital data contents; 
5 calculating the number ki of '1' or '0' included in 

said digital watermark sequence; 

calculating a probability F(ki) by using said 
binary distribution function F (x) ; and 

reconstituting '1' or '0' from ith digital 
10 watermark data wi if F(ki) > a , reconstituting '0' or 
^1' from ith digital watermark data wi if l-F(ki) > cx , 
and determining that there is no watermark data or the 
presence is unknown if both of F (ki) > a and l-F(ki) > 
a are not satisfied. 

15 

3 . The method as claimed in claim 2 , further 
comprising the steps of : 

outputting F(ki) as reliability if said 
reconstituted digital watermark data wi is ^1'; and 
20 outputting l-F(ki) as the reliability if said 

reconstituted digital watermark data Wi is '0'. 



25 



4. The method as claimed in claim 1, further 
comprising the steps of: 

setting a reliability threshold value a of the 
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extracted digital watermark data; 

obtaining a binary distribution function F (x) which 
represents a probability that a number x of ^1' bits or 
^0' bits are included in a bit sequence which is read at 
random from digital data contents, said binary 
distribution function F (x) being obtained by using a 
probability q of reading '1' or '0' in said bit sequence 
and a repeating number of embedding each bit of digital 
watermark data; 

reconstituting digital watermark data from said 
digital watermark sequence by using majority decision 
processing if said probability exceeds a , and 
determining that there is no watermark data or the 
presence is unknown if said probability does not exceed 

5. The method as claimed in claim 4, further 
comprising the step of: 

outputting said probability that said digital 
20 watermark sequence is digital watermark data as 

reliability of said reconstituted digital watermark data. 

6. The method as claimed in any of the claims 
1-5, if a data sequence which is embedded as said 

25 digital watermark data is modulated by a pseudo-random 
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sequence, said method further comprising the steps of: 
demodulating said modulated data sequence by said 
pseudo-random sequence before the digital watermark data 
is reconstructed. 

5 

7. The method as claimed in claim 1, if a 
data sequence which is embedded as said digital 
watermark data is modulated by a pseudo-random sequence, 
said method further comprising the steps of: 

10 setting a reliability threshold value a of the 

extracted digital watermark data ; 

obtaining a binary distribution function F(x) which 
represents a probability that a number x of '1' bits or 
^0' bits are included in a bit sequence which is read at 

15 random from digital data contents, said binary 

distribution function F (x) being obtained by using a 
probability q of reading '1' or '0' in said bit sequence 
and a repeating number t of embedding each bit of 
digital watermark data; 

20 demodulating said modulated data sequence by said 

pseudo-random sequence before the digital watermark data 
is reconstructed; 

assigning 1/2 to said probability q; 

obtaining a maximum number xo which satisfies 0= 

25 F(x=xo)=l-cK and a minimum number xi which satisfies 
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F(x=xi) ^1, a ; 

obtaining the number ki of '1' or ^0' included in 
said ith digital watermark sequence; and 

reconstituting ith digital watermark data wi as '0' 
5 or '1' if ki^xo, and, reconstituting said ith digital 
watermark data wi as ^1' or ^0' if ki^Xi. 

8. The method as claimed in claim 1, if a 
data sequence which is embedded as said digital 
10 watermark data is modulated by a pseudo-random sequence, 
said method further comprising the steps of: 

demodulating said modulated data sequence by said 
pseudo-random sequence before the digital watermark data 
is reconstructed; 
15 setting a reliability threshold value a of the 

extracted digital watermark data; 

obtaining a binary distribution function F(x) which 
represents a probability that a number x of ^1' bits or 
0 ' bits are included in a bit sequence which is read at 
20 random from digital data contents, said binary 

distribution function F (x) being obtained by using a 
probability q of reading ^1' or ^0' in said bit sequence 
and a repeating number t of embedding each bit of 
digital watermark data; 
25 assigning 1/2 to said probability q; 



-6- 

obtaining xo or xi which satisfies 0 {x=xo) = 1- « 
or a^F(x=Xi)^l; 

judging whether the average value of the bias from 
the center of the binary distribution of the watermark 
5 sequence is equal to or more than x ^ ; 

reconstituting digital watermark data by performing 
majority decision processing for said watermark sequence 
if said value is equal to or less than xo or equal to or 
more than xi; and 
10 determining that there is no digital watermark or 

the presence is unknown if said value is not equal to or 
less than xo or equal to or more than Xi. 



9 . The method as claimed in claim 8 , further 
15 comprising the step of outputting said average value of 

the bias from the center of the binary distribution of 
the watermark sequence as reliability of said 
reconstituted digital watermark data in case the digital 
watermark data is reconstructed. 

20 

10. A method for reconstituting digital 
watermark data embedded in digital data contents , said 
method comprising the step of: 

obtaining digital watermark data from the bias of 
25 appearance probability of the digital watermark data in 
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the binary distribution of appearance probability of 
each bit of 1 bit sequence extracted at random from 
digital data contents . 

11. An apparatus for reconstituting digital 
5 watermark data embedded in digital data contents, said 

method comprising: 

a reading means for reconstituting the digital 
watermark data embedded in the digital data contents 
from data sequence extracted from the data contents 
10 before being reconstituted by using a detection method 

based on binary distribution function F (x) in statistics. 

12. An apparatus as claimed in claim 10, said 
reading means comprising: 

15 means for obtaining a binary distribution function 

F (x) f rom an appearance probability of each bit of 1 bit 
sequence extracted at random from digital data contents 
and a repeating number t of each bit of digital 
watermark data; 

20 means for extracting digital watermark data 

sequence with respect to each bit value of the digital 
watermark data; 

means for obtaining the appearance probability of 
the extracted digital watermark sequence from said 

25 obtained binary distribution function F (x) ; 
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means for judging whether the obtained appearance 
probability or 1- appearance probability is more than a 
threshold value of reliability; and 

means for reconstituting the digital watermark data 
5 if the data is judged to be more than said threshold 
value . 

13. There apparatus as claimed in claim 12, 
comprising : 

10 means for obtaining reliability regarding said 

reconstituted data bit from the appearance probability 
and outputting the same together with the reconstituted 
data bit. 

15 14. The apparatus as claimed in claim 11, if 

a data sequence which is embedded as said digital 
watermark data is modulated by a pseudo-random sequence, 

setting a reliability threshold value a of the 
extracted digital watermark data, 

20 obtaining a binary distribution function F (x) f rom 

an appearance probability q of each bit of 1 bit 
sequence extracted at random from digital data contents 
and a repeating number t of each bit of digital 
watermark data ; 

25 said apparatus further comprising: 
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means for demodulating said modulated data sequence 
by said pseudo-random sequence before the digital 
watermark data is reconstructed, wherein said reading 
means comprising, 
5 means for obtaining the number ki of bit 1 or 0 

included in ith digital watermark sequence n j , 

assigning 1/2 to said probability q; 

obtaining a maximum number xo which satisfies 0= 
F(x=xo)^l-ct and a minimum number xi which satisfies ct ^ 
10 F(x=xi) ^1; 

obtaining the number ki of '1' or ^0' included 
in said ith digital watermark sequence. 

15. The apparatus as claimed in claim 1, 
15 further comprising: 

means for setting a reliability threshold value ct 
of the extracted digital watermark data; 

means for obtaining a binary distribution function 
F(x)from an appearance probability q of each bit of 1 
20 bit sequence extracted at random from digital data 

contents and a repeating number t of each bit of digital 
watermark data; 

means for obtaining probability whether the 
watermark sequence is watermark data by using the binary 
25 distribution function F (x) ; 



-10- 



judging means for searching whether the probability 

is above the threshold value a ; 

means for reconstituting digital watermark data by 
performing majority decision processing for said 
watermark sequence read from the data contents when the 
judging means judges the probability is above the 
threshold value a ; and 

means for judging that there is no digital 
watermark or the presence is unknown if said probability 
is not above the threshold value a . 

16. The apparatus as claimed in claim 15, 
further comprising : 

a means for outputting said probability as 
15 reliability of said reconstituted digital watermark data. 

17. The apparatus as claimed in claims 11, 13, 
15, 16, a data sequence which is embedded as said 
digital watermark data is modulated by a pseudo-random 
20 sequence, further comprising: 

means for demodulating said modulated data contents 
by said pseudo-random sequence before the digital 
watermark data is reconstructed. 
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18. The apparatus as claimed in claim 11, 
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wherein : 

the reliability threshold value a of the extracted 
digital watermark data is set; 

the binary distribution function F (x) f rom an 
5 appearance probability q of each bit of 1 bit sequence 
extracted at random from digital data contents and a 
repeating number t of each bit of digital watermark data 
are obtained; 

the data sequence embedded as said digital 
10 watermark data is modulated by a pseudo-random sequence, 

the watermark apparatus includes a means for 
demodulating said modulated data contents by said 
pseudo-random sequence before the digital watermark data 
is reconstructed; and 
15 said extracting means includes: 

a judging means which assigns 1/2 to said 
probability q, and by comparing a number xo which 
satisfies 0 (x=xo) = 1- a and a number xi which satisfies 
a^F(x=xi)^l with the average value of bias from the 
20 center of the binary distribution of the watermark, 

judges the average value is equal to or less than the 
average value or equal to or more than the average 
value ; 

means for judging whether the average value is 
25 equal to or less than the average value or equal to or 
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more than the average value; 

means for reconstituting digital watermark data by 
performing majority decision processing for said 
watermark sequence read from the data contents when the 
5 judging means judges the average value is equal to or 

less than the average value or equal to or more than the 
average value; and 

means for judging that there is no digital 
watermark or the presence is unknown when the judging 
10 means judges the average value is not equal to or less 
than the average value or not equal to or more than the 
average value. 

19. The apparatus as claimed in claim 17, 
15 further comprising means for outputting said average 

value of the bias from the center of the binary 
distribution of the watermark sequence as reliability of 
said reconstituted digital watermark data in case the 
digital watermark data is reconstructed. 

20 

20. A memory medium which stores a program 
for reconstituting digital watermark embedded in data 
contents , comprising : 

a performing means for reconstituting the digital 
25 watermark data embedded in the digital data contents 
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from data sequence extracted from the data contents 
before being reconstituted by using a detection method 
based on binary distribution function F (x) in statistics. 

5 21. A memory medium as claimed in claim 20, 

wherein a reliability threshold value ct of the 
extracted digital watermark data is predetermined, 

said reconstituting process of digital watermark 
further comprising : 
10 processing means for obtaining a binary 

distribution function F (x) from an appearance 
probability q of each bit 1 or 0 bit sequence extracted 
at random from digital data contents and a repeating 
number of each bit of digital watermark data, wherein 
15 the binary distribution function F (x) represents the 

probability of x numbers of 1 or 0 in said bit sequencer- 
processing means for extracting the data watermark 
sequence ni from each bit of the digital watermark data 
from target area for embedding watermarks from the 
20 information contents; 

processing means for calculating numbers Ki of bit 
1 or bit 0 included in the extracted data watermark 
sequence ni; 

processing means for reconstituting the ith digital 
25 watermark data Wi to be 1 or 0 if F(Ki)>a; 



-14- 



processing means for reconstituting the digital 
watermark data Wi to be 0 or 1 if l-F(Ki)>a; 

processing means for judging that there is no 
digital watermark or the presence is unknown if it 
5 neither F{Ki)>a nor l-F(Ki)>a. 



22. A memory medium as claimed in claim 21, 
further comprising : 

means for outputting F(ki) as its reliability when 
10 the reconstituted digital watermark data Wi is 1; 

processing means made by a computer for outputting 
l-F(Ki) as its reliability when the reconstituted 
digital watermark data Wi is 0 . 

15 23. A memory medium as claimed in claim 20, 

wherein a reliability threshold value a of the 
extracted digital watermark data is predetermined, 

said reconstituting process of digital watermark 
further comprising : 

20 processing means for obtaining a binary 

distribution function F (x) from an appearance 
probability q of each bit 1 or 0 bit sequence extracted 
at random from digital data contents and a repeating 
number of each bit of digital watermark data, wherein 

25 the binary distribution function F (x) represents the 
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probability of x numbers of 1 or 0 in said bit sequence; 

processing means for obtaining probability which 
represents whether the watermark sequence is the 
watermark data or not by using the binary distribution 
function F (x) ; 

processing means for detecting whether said 
probability is above the threshold value gl or not; 

processing means for reconstituting digital 
watermark data by performing majority decision 
processing for said watermark sequence read from the 
data contents when the judging means judges the 
probability is above the threshold value a ; and 

means for judging that there is no digital 
watermark or the presence is unknown if said probability 
is not above the threshold value a . 

24. A memory medium as claimed in claim 23, 
further comprising : 

processing means made by said computer for 
20 outputting said probability as its reliability of the 
reconstituted digital watermark data. 

25. A memory medium as claimed in any of the 
claims 20 to 24, wherein said data contents is a 

25 modulation of actually embedded digital sequence as 



10 



-16- 



digital watermark data by pseudo-random sequence, the 
memory medium further comprising: 

processing means made by said computer for 
demodulating said modulated data contents by pseudo- 
5 random sequence before the digital watermark data is 
reconstructed . 

26. A memory medium as claimed in claim 20, 
wherein said data contents is a modulation of 
10 actually embedded digital sequence as digital watermark 
data by pseudo-random sequence, 

wherein a reliability threshold value cc of the 
extracted digital watermark data is predetermined, 
wherein a binary distribution function F (x) is 
15 obtained from an appearance probability q of each bit 1 
or 0 bit sequence extracted at random from digital data 
contents and a repeating number t of each bit of digital 
watermark data, wherein the binary distribution function 
F(x) represents the probability of x numbers of 1 or 0 
20 in said bit sequence, 

processing means for reconstituting said digital 
watermark data comprising: 

processing means for demodulating said modulated 
data contents by pseudo-random sequence before the 
25 digital watermark data is reconstructed; 
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processing means for obtaining numbers Ki of bit 1 
or bit 0 included in ith digital watermark data Wi; 

processing means for restructuring the ith digital 
watermark data Wi to 0 or 1 if Ki, which assigns 1/2 to 
5 an appearance probability q, is equal to or less than 
the largest value of xq which satisfies 0 (x=xo) = 1- ct ; 
and 

processing means for restructuring the digital 
watermark data Wi to 1 or 0 if Ki , which assigns 1/2 to 
10 an appearance probability q, is equal to or more than 
the smallest value of xi which satisfies a^F(x=xi)^l. 



27. A memory medium as claimed in claim 20, 
wherein said data contents is a modulation of 
15 actually embedded digital sequence as digital watermark 
data by pseudo-random sequence, 

wherein a reliability threshold value a of the 
extracted digital watermark data is predetermined, 
wherein a binary distribution function F (x) is 
20 obtained from an appearance probability q of each bit 1 
or 0 bit sequence extracted at random from digital data 
contents and a repeating number t of each bit of digital 
watermark data, wherein the binary distribution function 
F(x) represents the probability of x numbers of 1 or 0 
25 in said bit sequence. 
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wherein xo or xi, which assign 1/2 to an appearance 
probability q, are obtained which satisfies O^F(x=xo) = 
1-a or a (x=xi) ^1 , a , 

the memory medium further comprising: 
5 processing means for demodulating said modulated 

data contents by pseudo-random sequence before the 
digital watermark data is reconstructed; 

processing means for judging the average value of 
the bias from the center of the binary distribution of 
10 the watermark sequence is equal to or less than the 
average value xo or equal to or more than the average 
value xi ; 

processing means for reconstituting the digital 
watermark data; 

15 processing means for reconstituting digital 

watermark data by performing majority decision 
processing for said watermark sequence read from the 
data contents when the judging means judges the 
probability is equal to or less the average value xo or 

20 equal to or more than the average value xi ; and 

processing means for judging that there is no 
digital watermark or the presence is unknown if said 
probability is not equal to or less the average value xo 
or not equal to or more than the average value xi . 
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[Detailed Description of the Invention] 
[Field of the Invention] 

The present invention generally relates to a 
digital watermarlcing technique. More particularly, the 
5 present invention relates to a digital watermarking 
technique for embedding or reading digital watermarlc 
data in digital data contents which represent an image 
or a sound. In addition, the present invention relates 
to a technique for statistical processing of read 

10 watermark data in a system using the digital 
watermarking technique . 
[Prior Art] 

Conventional techniques are proposed in 
Japanese patent applications No. 8-305370, No. 8-338769, 

15 No. 9-9812, No. 9-14388, No. 9-109924, No. 9-197003, No.9- 

218467 and No. 10-33239. The digital watermark method is 
also called data hiding, finger printing steganography , 
image/sound deep encryption and the like. As for a 
digital watermarking system, accuracy for determining 

20 the presence or absence of embedded data is important. 
In addition, reliability of embedded data is important. 
The digital watermarking system generally has a 
mechanism for reconstituting correct digital watermark 
data even when sub-data embedded in the data contents is 

25 corrupted to a certain extent, since the digital 
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watermarking system assumes various processing on the 
watermarked data contents. However, under present 
circumstances, it is impossible for the system to 
evaluate validity of reconstituted digital watermark 
5 data quantitatively. Therefore, the system does not 
have enough reliability. 
[Object of the Invention] 

It is an object of the present invention to 
evaluate quantitatively probabilities of cases that data 

10 contents which do not contain digital watermark data are 
wrongly judged as containing digital watermark data, and 
incorrect digital watermark data is read from 
watermarked digital data contents . 
[Means to Solve the Problems] 

15 Digital watermark processing is comprised of a 

pair of digital watermark embedding/digital watermark 
extraction. In digital watermark embedding processing, 
digital watermark embedding area B^A is selected from 
the digital watermark target area in data contents by 

20 means of secret key information so that data in area B 
is changed by an inherent rule. In digital watermark 
extraction processing, data of the digital watermark 
embedding area B is interpreted and the digital 
watermark data is reconstituted. The present invention 

25 judges the probability of occurrence of the digital 
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watermark data read from the watermark embedding area B 
by means of the correct secret key data, based on a 
binary distribution in statistics of digital watermark 
data read by means of any secret key data regardless of 
5 true or false from A which is an overall digital 

watermark target area, by means of the digital watermark 
algorism which is to be an applied target of the 
invention, in the data contents embedded with digital 
watermark . 
10 Effect 

The present invention, in an digital watermark 
technique, can evaluate the credibility of the watermark 
data read from the data contents, can judge whether the 
data contents have the digital watermark or not, and can 
15 suppress the probability of reading incorrect digital 
watermark in an certain value from data contents which 
the digital watermark is included. 
[Embodiments of the Invention] 
Embodiment 1 

20 Before explaining embodiments of the present 

invention, definition of some words will be given. 
''Digital watermark data sequence" represents a data 
sequence read from the digital data contents before 
being reconstituted. ''Digital watermark data" represents 

25 significant data for system operation, which data needs 
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to be embedded in the digital data contents, or, data 
obtained by reconstituting the digital watermark 
sequence. '^^Reliability ct of digital watermark" is an 
index representing validity of read digital watermark 
5 data. That is, it represents a probability that the 
read digital watermark data matches with the actual 
embedded digital watermark data. Conversely, a 
probability of reading digital watermark data from an 
image without digital watermark data or reading 
10 erroneous digital watermark data can be represented as 
2 (1-a ) . 

Similarly, embedded sequence" represents data 
to be actually embedded. The embedded sequence includes 
sequence of embedded data which is modulated, extended 
15 or repeated. In addition, ^^read" may be replaced with 
"extract" in some cases. 

Fig.l shows a digital watermarking system of 
the present invention. In the system shown in Fig.l, 
digital watermark data 101 is embedded in digital data 
20 contents 103 by a digital watermark embedding apparatus 
102, then, converted into watermarked digital data 
contents 104. 

The watermarked digital data contents 104 are 
degraded to watermarked digital data contents 105 by 
25 compression or image processing while the watermarked 
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digital data contents 104 are distributed by wireless or 
wire communication or by a packaged medium. 

A digital watermark reading apparatus 107 
reads a watermark sequence from the degraded watermarked 
5 digital data contents 105, and reconstitutes digital 
watermark data 108. 

Fig. 2 is a block diagram of the watermark 
reading apparatus 107. The digital watermark data 
reconstitution apparatus 108 provided in the watermark 

10 reading apparatus 107 obtains the probability q that bit 
1 is read when any 1 bit watermark sequence is read from 
a whole watermark area beforehand by using the watermark 
reading apparatus 107. 

Specifically, assuming a 1 bit watermark 

15 sequence reading part 501, the part 501 reads the 

watermark sequence 1 bit by 1 bit from all elements of 
the whole watermark area (a broken line Ll) , and 
calculates the ratio of the number of bit 1 to the 
number of all trials. 

20 In the embodiment, the reading probability of 

bit 1 and the number of bit 1 are obtained. However, it 
is possible that the reading probability of bit 0 and 
the number of bit 0 are obtained. Basically, there is 
no difference between the former and the latter. The 

25 difference is only on implementation. 
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Accordingly, the probabilities of detecting 
bit 0 and 1 when reading 1 bit at random in the 
watermark area by using the digital watermarking 
algorithm is calculated to be 1-q and q respectively. 
5 The n bit watermark sequence reading part 502 

reads the digital watermark data sequence from the 
watermarked digital data contents for the number of 
total times of embedding digital watermark data. 

Here^ digital watermark data is defined as bo, 
10 bi, bm-i, bi ^{0, 1}, i<m (m bit length), the 

repeating number of embedding ith bit of the digital 
watermark data in the digital data contents is defined 
as the read watermark sequence is defined as 

b'o,Of b'o,i/ —b'cnO-lf b'i,Of b'i,i, ... b'i,ni-i/... fb'm-i,o, b'm- 
15 1,1, ... b'xn-i,nm-i -1 bi,j ^{0, 1} (Y!"r=!> ^rbit length). 

The data reconstitution apparatus 108 receives 
a subsequence of the digital watermark data sequence one 
after another from a subsequence corresponding to 0th 
digital watermark data to a subsequence corresponding to 
20 (m-l)th digital watermark data (a solid line L2) . 

Next, the method for reconstituting ith bit of 
the digital watermark data will be described concretely. 

When ni bits of digital watermark data 
sequence is read at random from the watermark area, the 
25 probability P (x=k) of k '1' bits appearing in the ni bit 
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sequence is represented by the binary distribution 
density function 

p (x=k) =niCkq^- (1-q) '^^"^ (1) 
and the distribution function of that, F (x) , is 
5 F(x)= XLo niCkq^- (1-q)"'-^ (O^x^ni). (2) 

Here, niCk is the number of combinations when selecting 
k out of n i . 

Setting a reliability threshold value a(l/2<a 
^1) of the digital watermark data, the number of bit 1 
10 included in a subsequence b'i,Of b'i,i, ...b'i,ni-i 
corresponding to ith digital watermark data is 
calculated by 

Then, digital watermark data is determined in the 
15 following way by using the formula (2) : 

r 0 when O^F(ki)^l-a 

bi = I 1 when a^F(ki)^l (3) 

^ unknown or when l-a< F(ki)<a 

20 not present 

Viewing from a different angle, when 
determining by the number of bit 1 included in the 
watermark sequence n i , if the largest integer xo that 
satisfies 0~F(x = xo) ^1-a and the smallest integer xi 
25 that satisfies a (x = xi) ^1 are assumed to be 
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threshold values, the digital watermark data is judged 
as shown in Fig. 3 such that if the number of 1 in ni is 
equal to or smaller than xo , the digital watermark data 
is 0, and that if the number of 1 is equal to or larger 
5 than xi, the digital watermark data is 1. 

The horizontal axis of Fig. 3 represents the 
number of bit 1 included in the watermark sequence, and 
the vertical axis represents frequency of the 
corresponding number. As for unwatermarked digital data 

10 contents, the frequency that bit 1 appears in a bit 

sequence read at random from the digital data contents 
becomes binary distribution. Thus, the peak of the 
frequency is at the half point of the number of bits. 
On the other hand, as for watermarked contents, in the 

15 subsequence ni in which bit 0 is embedded as digital 

watermark data, the frequency of bit 1 is 0 if there is 
no degradation and it is a small number which is equal 
to or smaller than xo even if there is degradation. In 
the subsequence ni in which bit 1 is embedded as digital 

20 watermark data, the frequency of bit 1 is nl if there is 
no degradation, and it is a large number which is equal 
to or larger than xi even if there is degradation. In 
this way, the distribution of the frequency of bit 1 or 
bit 0 in the watermarked sequence is leaning to one side 

25 from the center of the binary distribution. The present 
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invention uses the lean for reconstituting digital 
watermark data from the read watermark sequence . 

Depending on a watermarking system, a 
following method can be used. That is, reconstituted 
5 digital watermark data is obtained by using the bias 
from the central value of the distribution P (x) of the 
watermark sequence extracted from digital data contents 
105. Next, the probability of appearing the read 
watermark sequence is calculated by the formula (2) . 

10 Then, if the reconstituted digital watermark data is 1, 
F(ki) can be added to watermark dada as the reliability, 
and, if the reconstituted digital watermark data is 0, 
l-F(ki) can be added. The reliability F(ki) and 1-F (ki) 
of the digital watermark data is obtained from the bias 

15 of appearance probability of the digital watermark data 
in the binary distribution of appearance probability of 
each bit of 1 bit sequence extracted at random from 
digital data contents. 

Fig. 4 shows a concept in which the length of 

20 the digital watermark data is extended to m bits. 

The digital watermark data reconstitution 
apparatus 108 outputs the reconstituted digital 
watermark data bo, bi, ... , bm-i as read digital watermark 
data 106. 

25 Fig. 5 is a flowchart showing the above- 
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mentioned process. The process will be described in the 
following with reference to Fig. 5. 

Watermarked digital data contents 105 and key 
data which is necessary for reading digital watermark 
5 data is input, and a digital watermark data sequence is 
extracted with respect to each bit value in step 1 . 
Then, a threshold value a of the reliability is set in 
step 2, and a probability q that bit 1 appears when 1 
bit of digital watermark data is read at random from the 

10 whole watermark area is obtained in step 3. Then, a 
binary distribution function F (x) which represents 
probability that x bits of 1 are included in the bit 
sequence is obtained from the probability q and the 
repeating number n j of each bit of digital watermark 

15 data in step 4. 

Then, 0 is assigned to i which distinguish a 
subsequence of the digital watermark data sequence in 
step 5. Next, the number of bit 1 in the subsequence is 

r=o ^'i.r and the appearance 

20 probability F(ki) is obtained, then it is determined 
whether F(ki) is equal to or less than 1-a in step 6. 
If F(ki)^l-a, the digital watermark data w' i is 
reconstituted as 0 in step 7. Then, i is incremented by 
1 in step 8, and the process goes back to step 6 if i<m 

25 in step 9. If F(ki)^l-a is not true in step 6, it is 
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checked whether F(ki)^a is true in step 10. If F (ki) ^ 
a , the digital watermark data w i is reconstituted as 1 
in step 11, and the process goes to step 8. If F (ki) ^ a 
is not true in step 10, the process ends by determining 
5 as there is no watermark or the presence or absence is 
unknown in step 12. If i is more than ni in step 9, a 
reconstituted watermark sequence {w' ±} is output. In 
the above process, the reading process in step 1 can be 
carried out between step 4 and step 5. In step 6, it is 

10 checked whether l-F(ki) is more than a. 

In the first embodiment, it is assumed that 
there is no bias in the distribution represented by 
formula (1), that is, q=l/2. 

When the embedding number ni of each bit of 

15 digital watermark data is adequate for obtaining a 
statistical characteristic, it becomes q= 1/2 
generally. However, since the value of q depends on 
characteristics of an watermarking algorithm and digital 
data contents, q may take a value deviating largely from 

20 1/2 in some rare cases. A method for solving this 
problem will be described in a second embodiment. 
Second Embodiment 

In the following, the second embodiment will 
be described. Fig. 6 is a block diagram of a 

25 watermarking system of the second embodiment. 
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The watermark embedding apparatus 102 embeds 
digital watermark data 101 in digital data contents 103. 
At the time, when embedding each bit value ni times 
repeatedly, watermark sequence is modulated and embedded 
5 in the digital data contents 103. The modulation is 
carried out by a pseudo-random sequence generator (A) 
501 which is provided in the watermark embedding 
apparatus 102 . 

For example, when assuming the embedding 
10 sequence as bo,Of bo,i, ...bo,no-if bi,o, bi,i, ... bi,ni-i,- fbm-i,o, 
bm-1,1, ».bm-i,nm-i -1 bi,j ^{0, 1}, and the pseudo-random 

sequence as ri^o, ^1,1, ...ri,ni-i bi,j ^{0, 1}, the 
embedding sequence is modulated to 
mi,o, mi,i, ...mi,ni-i 
15 mi^j = bi,j ( + ) ri,j 

by the pseudo-random sequence. A(+)B represents XOR of 
A and B. 

According to the above-mentioned process, the 
same pseudo-random sequence is necessary for digital 
20 watermark data reading. 

For example, if 1 bit watermark sequence is 
read by using an M-sequence as the pseudo-random 
sequence, it becomes q=l/2. Therefore, the present 
invention can be applicable without depending on the 
25 watermarking algorithm and digital data contents. 
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When digital watermark data reading, 
demodulation is carried out as b'i,j = mi,j ( + ) ri^j by 
using a pseudo-random sequence generator (B) 502 which 
is provided in the watermark reading apparatus 106. 
5 Here, the pseudo-random sequence generator 

(A) 501 and the pseudo-random sequence generator (B) 
502 needs to be implemented such that both of the 
generators generate the same pseudo— random sequence. 

Watermark data is reconstituted with the 
10 method of the first embodiment from the watermark 
sequence b'o,o, b'o,i, ...b'o,no-i. b'i,o, b'i,i, ... b'i,ni- 

1,... ,b'm-i,o, b'm-1,1/' -b'm-l^nm-l -1 bi,j ^{Oj 1} 

obtained by the demodulation. 

Since it is considered that the appearance 

15 probability q of bit 1 in the watermark sequence can be 
approximated by the binary distribution regardless of 
the presence or absence of modulation, there is no 
influence on the distribution of the density function 
(1) due to the modulation shown in this embodiment. 

20 In addition, q=l/2 can be assumed in 

implementation, that is, no process is necessary for 
obtaining q. Therefore, the amount of processing that 
is required for watermark reconstitution thus becomes 
the same as that for majority decision processing. Thus, 

25 the reconstitution process becomes faster. 
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Third Embodiment 

In the following, a third embodiment will be 
described. In the third embodiment, an example will be 
described showing concrete values on the basis of the 
5 first embodiment and the second embodiment. In this 

embodiment, it is assumed that digital watermark data is 
1 bit, the repeating number n of embedding is 127 and 
the probability q that bit 1 is read when reading 1 bit 
watermark sequence at random from the whole watermark 

10 area is 1/2. If the threshold value a is 0.99999 

(which means 99.999%), xo in Fig. 21 is 36 and xi is 90. 
That is to say, according to the present invention, 
under the above-mentioned condition, digital watermark 
data is judged as bit 0 if the number of ^1' appeared in 

15 the watermark sequence (n bits) is equal to or less than 
36, and it is judged as bit 1 if the number of ^1' 
appeared in the watermark sequence (n bits) is equal to 
or more than 90, and it is judged that there is no 
watermark data or the presence or absence is unknown in 

20 other cases. If it is judged that there is digital 

watermark data, the correctness of more than 99.999% can 
be ensured. 
Fourth Embodiment 

A fourth embodiment will be described in the 

25 following. According to the embodiment shown in Fig. 5, 
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as is understood from the above-mentioned procedure, if 
even the reliability of only 1 bit is not obtained, that 
is, if F(ki) or 1-F (ki) is less than a, the 
reconstitution of the digital watermark data becomes 
5 impossible because it is judged that there is no digital 
watermark data or the presence or absence is unknown. 
The fourth embodiment solves the problem. In this case, 
it is assumed that the repeating number of embedding 
each bit of digital watermark data is the same value n. 

10 The method for reconstituting digital 

watermark data wo, wi , ... , Wm-i from watermark sequence 
h'o^o, b'o,if ...b'o,no-if b'i,Of b'i,i, ... b'i,n-if... ,i>'m,o, b'm,i, 
...b 'm,n-i which is read from digital data contents will be 
described in the following with reference to Fig. 7. 

15 The watermark sequence is read with respect to 

each bit value from the digital data contents and key 
data necessary for digital watermark data reading in 
step 1 . 

The threshold value a (l/2<a^l) of the 
20 reliability is set in step 2. For example, if the 

reliability of read digital watermark data needs to be 
equal to or more than 99%, it is set as a =0.99. 

The probability q of bit ^1' when 1 bit of the 
watermark sequence is read at random from the whole 
25 watermark area of watermarked digital data contents is 
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15 



20 



obtained beforehand in step 3 . The appearance 
probabilities of bits '0' and '1' are calculated as 1-q 
and q respectively. 

The probability that x bits of ^1' are 
included in the watermark sequence of each bit data of 
digital watermark data are obtained as 

F(x)=Sy=o nCjq^- (l-q)""=' 
by using the binary distribution function in step 4. 

It is checked in step 5 that the probability 
that n bit digital watermark data sequence is digital 
watermark data exceeds the threshold value a . 
Specifically, it is checked whether the following 
formula (4) is satisfied. 



n-i 

s*« -f 



m 



n 
2 



>a 



(4) 



Here, |a| represents the absolute value of a. Xi/=o ^^^2" 
n/2 represents the bias from the center of the binary 
distribution of the number of bit ^1' in the n bit 

1=0 2uj^o divided by m 

represents the average for the m bits of the whole 
digital watermark data. n/2 represents the center of 
the binary distribution. 

If the formula (4) is true, it is judged that 
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10 



there is digital watermark data. Thus, in each n bit 
watermark sequence of m digital watermark data sequences, 
digital watermark data is reconstituted by a majority 
decision processing . 

Specifically, if it is judged that there is 
digital watermark data, digital watermark data is 
reconstituted in the following way in step 6. 

For all i (0^i<m) , 



when 2J=o t>i,j<n/2 :w'i=0, 
when ^Jj, bi,j>n/2 :w'i=l. 
This process is carried out by steps 6-1 - 6-7 in Fig. 7. 



If F 



1=0 [/ =0 



ILK 



m 



n 
2 



<a , 



15 



it is judged that there is no watermark data or the 
presence or absence is unknown. A following formula (5) 
can be used instead of the formula (4) . 



n 
2 



m 



<l-a 



(5) 



If the formula (5) is not true, it is judged that there 
is no watermark data or the presence or absence unknown. 
According to the fourth embodiment. 
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statistical processing for whole watermark sequence is 
carried out so as to judge the presence or absence of 
watermark by using the formula (4) or the formula (5) . 
If it is judged that there is digital watermark data, 
5 the reconstitution is carried out by the majority 

decision processing. Therefore, even if there is one 
bit of low reliability, digital watermark data can be 
reconstituted . 

In Fig. 7, the step 1 can be carried out 

10 between the steps 4 and 5. 

The fourth embodiment may use the pseudo- 
random sequence which is described in the second 
embodiment. Specifically, watermark embedding is 
carried out by modulating digital watermark data 

15 sequence with the pseudo-random sequence. When 

reconstituting, the read digital watermark data sequence 
is demodulated by the pseudo-random sequence, then the 
judgment by the formula (4) is performed . If the 
result is more than cc and there is digital watermark 

20 data, the reconstitution process of the majority 

decision is performed on the demodulated sequence, which 
is the same process as the step 6 of the fifth 
embodiment. The whole process is shown in Fig. 26, 
adding the same reference symbol to the corresponding 

25 part shown in Fig. 7. In the example, the pseudo-random 
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sequence {ri,j) is generated from key data 'Key' and the 
process goes to step 2 in step 8. Next to step 4, 
watermark sequence is demodulated with the pseudo-random 
sequence {ri,j} in step 9. The watermark bit b'i,j in the 
5 formula (4) in step 5 is a bit which is demodulated in 
step 9. Also, the majority decision processing in step 
6 is performed on b'i,j. 
Fifth Embodiment 

In the following, a fifth embodiment will be 

10 described. 

Since digital watermark data is dispersed by 
the pseudo-random sequence, when q is approximated to 
1/2, the presence or the absence of watermark data in 
the watermark sequence can be judged as follows. 
15 The probability that x bits of '1' (a number x 

of '1' bits) are included in the n bit watermark 
sequence which constitutes each bit of digital watermark 
data is represented as 

F(X)= nCj(l/2") 

20 by using the binary distribution :^unction. 

Accordingly, by obtaining the smallest integer x j which 
satisfies F(x=xi)^a, the demodulated sequence of the 
step 5 in the tenth embodiment can be judged with the 
following formula (6) . 
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1=0 


;=0 





+ ^>Xi •••(6) 



In this case, the amount of processing can be reduced to 
the same level as that of the majority decision 
processing . 

The judgment is equivalent to a judgment for 
judging whether the average of the bias from the center 
n/2 of the binary distribution of the watermark sequence 
is equal to or more than x i . 

If the formula (6) is true and it is judged 
that there is digital watermark data, the majority 
decision process is performed on the watermark sequence 
which is demodulated by the pseudo-random sequence in 
the following way. 

For all i (0^i<m) , 

when b'i,j<n/2 : w'i=0, 

when t5'i,j>n/2 : w'i=l 

Then, the digital watermark data is reconstituted. 



If 



i=0|y=0 



m 



n 



it is judged that there is no watermark data or the 
presence or absence is unknown. 

In the above process, it is possible to use 



the maximum integer Xq which satisfies F(x=xo)=l~ct 
instead of the minimum integer x ^ which satisfies 
F(x=xi)^a. In this case, a formula for judging the 
presence or absence of watermark is shown below as a 
formula (7) . 



If the left part of the formula is more than x o , it is 
judged that there is no watermark data or the presence 
or absence is unknown. 
Sixth Embodiment 

In the following, a sixth embodiment of the 
present invention will be described. 

When it is judged that there is digital 
watermark data by the formula (4) , the digital watermark 
data is reconstituted by the above-mentioned majority 
decision process. At the same time, the reliability of 
the reconstituted watermark sequence as a whole is 
calculated as 




(7) 



2 



m 




n 



m 



2 



J 



and it is output. 
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Similarly, when it is judged that there is 
digital watermark data by the formula (5) and the 
digital watermark data is reconstituted, the reliability 
of the reconstituted digital watermark data sequence as 
a whole is calculated as 



n i=o|y=o 
2 " 



m 



and it is output. 

When it is judged that there is digital 
watermark data by the formula (6) , the digital watermark 
10 data is reconstituted by the above-mentioned majority 

decision process. At the same time, the reliability of 
the reconstituted watermark sequence as a whole is 
calculated as 



1=0 |7 =0 



m 



n 
*2 



15 and it is output. 

Similarly, when it is judged that there is 
digital watermark data by the formula (7) , the 
reliability of the digital watermark data as a whole is 
calculated as 
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m-l ^ 



1=0 |y=o 



2 



and it is output. 



In the above-mentioned first - sixth 



embodiments, the reading probability of bit 1 and the 
5 number of bit 1 are obtained. However, it is possible 
that the reading probability of bit 0 and the number of 
bit 0 are obtained. Basically, there is no difference 
between the former and the latter. The difference is 
only on implementation. 

10 In the following, examples of experiments will 

be shown. In the following experiments, an image of 
"lena" which has 128X128 pixels is used as a test image, 
and the threshold value a of the reliability is assumed 
to be 0.999999. 

15 First Experiment 



data '1' was embedded 127 times repeatedly using key 
data '50,000', and the watermark sequence was read with 
various key data. Fig. 9 shows the number of bit '1' in 
20 the read watermark sequence corresponding to the key 

data. In Fig. 9, the vertical axis shows the number of 
bit ^1' in the read watermark sequence, and the 



In this experiment, 1 bit digital watermark 
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horizontal axis shows the key data value. In this 
experiment, the appearance frequency of bit ^1' in the 
watermark area A was q=0. 492247. 

When correct key data (50,000) is used, it is 
5 judged that digital watermark data is ^1' with 99.9999% 
correctness since the number of bit ^1' is more than the 
threshold value for judging the presence of watermark. 

When incorrect key data is used, it is judged that there 
is no watermark data or the presence or absence is 

10 unknown. 

Second Experiment 

In the second experiment, a watermark sequence 
which was modulated with a 7 stage M-sequence (initial 
state is 64) was embedded, and a similar experiment as 

15 the first experiment was carried out with various key 
data and M-sequences of various initial states . The 
result is shown in Fig. 10. By carrying out the 
modulation, the value of q becomes 0.500000 from 
0.492247, and the variance becomes 31.718777 from 

20 31.008265. Thus, the values are almost not changed from 
those of the first experiment. It is only when correct 
key data and correct pseudo-random sequence are used 
that digital watermark data can be read. In addition, 
when the watermark sequence is embedded in half data of 

25 the watermark area A, q=0. 741547 with the modulation and 
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q=0. 499768 without the modulation. 

[Advantages of the Invention] 

The effects of the present invention 
5 corresponding to the second object is as follows, 

(1) There are following effects by judging 
digital watermark data on the basis of the binary 
distribution in statistics : 

- The probabilities of following cases can be 
10 evaluated quantitatively. The cases are: digital data 

contents which do not contain digital watermark data are 
wrongly judged as containing digital watermark data, and 
incorrect digital watermark data is read from 
watermarked digital data contents. In addition, the 
15 probability can be suppressed within 2(l-a) by using 

the reliability threshold cx of digital watermark data. 

(2) There are following effects by modulating 
digital watermark data by a pseudo-random sequence 
before embedding the digital watermark data: 

20 - The bias of the probability q of reading bit '1' when 
1 bit watermark sequence is read at random from the 
whole watermark area . 

- It becomes difficult to detect the presence or 
absence of watermark data and the value from the bias of 

25 q without the correct key data and the pseudo-random 
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sequence, the key data being necessary for reading 
digital watermark data and the pseudo-random sequence 
being necessary for demodulating read watermark sequence. 
It can strengthen security which is an important element 
5 for the digital watermarking system. 

- In an implementation, since it can be assumed to be 
q=l/2, the amount of processing that is required for 
watermark reconstitution becomes the same as that for 
majority decision processing. Thus, the speed of the 

10 processing becomes higher. 

a is an index which represents a lower limit 
of the correctness rate of read digital watermark data, 
and is manageable in the digital watermarking system. 
Therefor, the method of using a is superior to a 

15 conventional method of showing the correctness rate of 
read digital watermark data to a user. 

According to the first embodiment, if there is 
even one bit of low reliability in digital watermark 
data {w' i} , it is judged that there is no watermark data 

20 or the presence or absence is unknown. However, even in 
the case, according to the eleventh - thirteenth 
embodiments, the reliability of digital watermark data 
can be evaluated quantitatively, the probability for 
reading digital watermark data incorrectly can be 

25 suppressed within 2(1- a), and the digital watermark 
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data can be reconstituted. In the tenth - twelfth 
embodiments, the whole digital watermark data is 
statistically processed by modifying the formula for 
judging the presence or absence of digital watermark 
5 data, since digital watermark data can be reconstituted 
in many cases, when watermark sequence {b' (0^i<m,0 
^j<n) is seen statistically as a whole. 

In addition, according to the first 
embodiment, F( ^J^q ) needs to be calculated with 

10 the distribution function F (x) of the binary 

distribution for all i to reconstitute digital watermark 
data from watermark sequence. On the other hand, 
according to the fourth - sixth embodiments, only one 
calculation using the distribution function is necessary 

15 so that the amount of processing can be reduced. 

The present invention becomes more effective 
in combination with an error correction code. That is, 
when a part of bits in digital watermark data is 
intensively corrupted, it is judged that only the part 

20 of bits is unknown and other bit data is in high 

correctness rate. Therefore, correct data can be read 
by correcting only the corrupted bit data. 
[Brief Description of the Drawings] 

Fig.l is a diagram showing an overview of a 

25 digital watermarking system; 
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Fig.2 is a diagram showing an overview of 
digital watermarking extracted apparatus ; 

Fig. 3 is a diagram showing a judgment of 
digital watermarking data; 
5 Fig. 4 is a diagram showing an overview of 

digital watermarking data reconstitution ; 

Fig. 5 is a flowchart showing steps of a 
digital watermark extraction process; 

Fig. 6 is a diagram showing an overview of the 
10 second embodiment of this invention; 

Fig. 7 is a diagram showing processing steps of 
the fourth embodiment of this invention; 

Fig. 8 is a flowchart showing processing steps 
of the fourth embodiment of this invention in case a 
15 target is an embedding of the modulated pseudo-random 
number watermark data; 

Fig. 9 is a diagram showing result (no 
modulation) of the watermark sequence readings; 

Fig. 10 is a diagram showing result (with 
20 modulation) of the watermark sequence readings. 
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[Name of the Document] Abstract 
[Abstract] 

[Object] Object of this invention is to quantitatively 
evaluate the probability of reading the incorrect 
5 digital watermark from the data contents which include 
the digital watermark. 

[Solution Means] When ni bits of digital 

watermark data sequence is read at random from the 
watermark area, the probability P{x=k) of k '1' bits 
10 appearing in the ni bit sequence is represented by the 
binary distribution density function 

P{x=k)=niCkq^- (1-q)^^-*^ (1) 
and the distribution function of that, F (x) , is 
F(x)= ZLo HiCkq^- (1-q)""''' (O^x^m). (2) 
15 Here, niCk is the number of combinations when selecting 
k out of n i . 

Setting a reliability threshold value a(l/2<a 
^1) of the digital watermark data, 
[Selected Figure] Fig. 3 
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